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(57) Abstract: A communication method, comprising the steps of a sender 21 sending a message comprising at least one sireamable 
component and infonnation describing it to a communication server MMSC and the communication server responsiyely sending 
to a receiver 24 a notification message to notify about the availability of the sUieamable component The notification message is a 
multimedia message comprising the description for the streamable component. The communication server MMSC and the receiver 
form a streaming session for transferring the sb-eamable component using the information describing the streamable component 
The communication server MMSC then sUieams the streamable component to the receiver 24 in sequential sub-parts in the streaming 
session. Corresponding to the method, a communication system 20« a communication server MMSC, a communication device 21,24 
and computer program products for them are also described. 
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METHOD FOR FOKMZNO A MOIiTIHEDIA STREAMING SESSION 

This invention relates to communication services. It is related particularly, but not 
5 . exclusively, to streaming in a Multimedia Messaging Service (MMS). 

Electronic mail, or e-mail is a messaging service, which allows quick and 
economical communication in electronic fomri. Using the Internet, e-mail messages 
can be sent all over the world, In many cases practically free of charge. 
10 Furthermore, the sanne e-mail message can be sent to a plurality of recipients. 
This technique Is called multicasting. As the relaying of e-mail messages is entirely 
automated, ttie e-mail messages can arrive very shortly after they are sent. E-mail 
messages can carry computer files such as documents, program files, and 
different media files like audio- or video clips. 

15 

Ordinary home users having Personal Computers (PCs) prefer not to have a 
penmanent connection to their e-mail system (for example to the Internet) but 
rather to set up a temporary and remote connection to an e-mail server that stores 
messages received since a previous e-mail message reading session. Using this 
20 kind of connection and an e-mail message reading program, new e-mail messages 
can be transferred from the e-mall sender to the memory or a hard disk of a PC 
and then be read either while the connection Is still extant, or altematively after the 
connection has been closed. The transmissfon of data between the PC and the e- 
mail server is typically canied out using a modem attached to the PC. 

25 

In the following, the Xem "sender" refers to a device that sends data intended for a 
receiver and "receiver" refers to a device that receives the data and to which the 
data was intended. 

30 Figure 1 shows a schematic diagram of an internet-based e-mail system 10 
comprising a sender 1 1, a receiver 15 and the Internet 12 having a sender's e-mail 
sender 13 and a receiver's e-mail server 14. 
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In the Internet, e-mail messages are sent using certain well-known protocols. 
Simply speaking, an e-mail message, once composed, is packaged into a single 
unit, stamped with an address of the receiver and is sent to the sender's e-mail 
server. The sender's e-mail server fonwards the message through the Internet to 

5 the receiver's e-mail server. The next time the receiver fonns a connection to the 
receiver's e-mail server via the Internet and checks whether new e-mail messages 
have been received using an e-mail reading program, the receiver can download 
any newly received e-mail message over the connection (e.g. modem link). When 
the e-mail message has been received completely, it can be presented to the user. 

10 It should be noted that during the various stages of its transmission, the e-mail 
message is typically split Into numerous smaller packets according to the data 
transfer protocol(s) used. On reception, the receiver gathers together all of the 
packets, assembles them into the correct order (if necessary) and reconstmcts the 
e-mail message into Its original form, before presenting the e-mail message to a 

1 5 user of the receiver. 

An e-mail transmisston system described above is convenient and provides the 
possibility for multicasting, but it is best suited, and originally intended, for 
receiving e-mail messages and ttien presenting them at the convenience of the 

20 user. Thus, the content of a given e-mail message can only be accessed after 
completion of the e-mail message transmission to the receiver. This is not a real 
problem with plain text form e-mail messages, but in the case of a large media or 
multimedia content (clip) it is a drawback that the user of the receiver cannot start 
presentation of the clip while it is still being downloaded. Another drawback is that 

25 in order to receive an e-mail message, the receiver must have a sufficiently large 
memory to accommodate the entire message. Particularly in mobile 
communications networks, or any other networi< in which part of the 
communications link is fonmed by a radio connection, it is also problematic to 
receive a long e-mail message without interruptions or enrors, for example due to a 

30 temporary loss of or deterioration in radio coverage. Mobile terminals also tend to 
have limited memory available for the storage of received e-mail messages, which 
further exacerbates the problem associated with the accommodation of messages 
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in the receiver. Tliese probiems are at least partly mitigated by tlie Multimedia 
Messaging Service (l\/IMS). 

Tiie MMS is a obw end-to-end messaging approacli for one-way transmission of 
5 multimedia messages iiaving text and/or multimedia content. MI\^S provides ttie 
possibility of sending multimedia messages between mobile users and between a 
mobile user and the intemet. There is already an agreed solution for 
implementation of MMS in 3"* Generation mobile communication networks. The 
curently specified features of the proposed MMS are described in 3"* Generation 

10 Partnership Project (3GPP) technical specification 23.140 V.3.0.1. "Multimedia 
Messaging Sen^ice (MMS), Functional Description, Stage 2 (Release 1999)". The 
MMS proposed In 3GPP 23.140 employs a store-and-fonward approach to 
multimedia message delivery. Mui&nedia messages are constructed in such a 
way that the media content, information necessary to describe the media content 

15 and addressing infomriation, identifying the intended receiver of the multimedia 
message, are encapsulated together. The multimedia message is then sent to an 
MMS Centre MMSC, which in turn notifies the receiver about the multimedia 
message. The multimedia message is downloaded by the receiving temninal as a 
whole and only presented to the user once downloaded and stored in the receiving 

20 terminal. 

It should be appreciated that although the tenn "multimedia message" is used 
generally to describe a message that contains more than one type of content, in 
this application, the tenn extends to cover messages that contain only one media 
25 type. 

As currently specified, the MMS has a drawback: the receiving terminal must store 
the multimedia message before it can be presented to the user. Therefore the size 
of the memory of the receiving terminal sets an upper limit on the size of 
30 multimedia messages that can be downloaded. WO 99/166746 solves this 
problem by dividing a message into sub-messages (segments) if the entire 
message would not fit into the memory of the receiving terminal. These sub- 
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messages are small enough so that the receiving terminal can individually 
download each of them as a whole. In that case, the receiving temilnal initially 
downloads a first sub-message. After the first sub-message has been fully 
downloaded, the receiving terminal can present it. After presentation of the first 
5 sub-message, the receiving temiinal can download a second sub-message and 
then present it. Each sub-message is downloaded and then presented by itself. 
The size of the sub-messages depends on the memory size of the receiving 
terminal and must be small enough to fit into the memory. 

10 Apart from MMS, there are streaming-techniques used in the Intemet for 
transmission over fixed lines. "Streaming'' is a tenm used generally to describe the 
presentation of a media stream, for example an audio or video stream, or a 
combination of different stress, in a continuous way while this stream or those 
streams are being transmitted to a client over a data network. A "stream" is a flow 

15 of data typically enabling the receiver to present some continuous data such as a 
motion picture, voice or music. In a typical video stream, some 10 to 20 video 
frames are transmitted per second. In practice, streaming can be either live (real- 
time) or performed In an on-demand fashion. As Its name suggeste, "live 
streaming" describes the creation of a media stream from a live source, for 

20 example a stream of digital images produced by a video camera, while "on- 
demand streaming" describes the creation of a media stream from, for example, a 
file stored on a server. Streaming also Involves establishing a streaming session, 
during which the stream or streams is or are transmitted to the client 

25 Within streaming there are two very important functionalities, namely streaming 
control and media transport. Streaming control takes care of establishing, 
managing and terminating a streaming session using a negotiated or pre- 
configured set of parameter values. Media transport concerns the transportation of 
media during the established session using an agreed or negotiated transport 

30 protocol. For example, there are widely agreed protocols in the Intemet to provide 
both streaming control and media transport functionalities and these can be used 
as transport protocols in streaming applications. 
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Whilst streaming is widely used in the Internet, It has still to be adapted for use In 
mobile communication networks. It should be appreciated that the use of 
streaming is desirable in mobile networks, since mobile terminals typically have 
limited storage capacity (memory). However, present mobile communication 
networks do not support streaming for reasons described in the following. 

The encapsulation of media content, message description and addressing 
Information In a single entity as proposed in current MMS specifications Is 
Incompatible with the streaming of media content. In order to establish a streaming 
session, It Is necessary for the receiving terminal to be aware, in advance, of 
certain Information relating to the media content. Such infomiatlon Includes, but is 
not limited to, the type of media contained In the multimedia message, the way 
that media Is encoded and a suitable transport protocol that can be used to 
download the media content. Because present MMS specifications require 
Information describing the media content to be encapsulated with the multimedia 
message itself, the receiving temilnal cannot obtain prior knowledge about the 
properties of the media content and therefore cannot establish any form of 
streaming session. Thus, according to the present MMS specification, the entire 
multimedia message must be downtoaded to the receiving tennlnal In order for the 
details of the media content to be extracted. Only then can any media content, 
such as video and/or audio clips be played back to the user of the receiving 
terminal. This limits the usability of the present MMS because multimedia clips are 
usually bulky in tenr^s of bits and therefore a receiving tennlnal, for example a 
mobile station, would require a comparatively large memory to completely receive 
the clips. The need to download an entire multimedia message before it can be 
presented may also give rise to significant delays in certain conditions, for 
example if the multimedia message Is very large, or the data transmission rate of 
the connection is low. 

It should further be emphasised that the addressing scheme suggested by current 
MMS specifications does not facilitate the implementation of streaming in such a 
system. The cun-ent MMS can be viewed as a "sender orientated" system. In other 
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words, the sender decides what media content to send to the receiver, 
encapsulates that in the multimedia message and addresses the multimedia 
message to the intended receiver. Streaming, on the other hand, is more "receiver 
orientated". To establish a streaming session, it is generally necessary for a 
5 streaming connection to be formed between the receiver and the sender, for 
example a network-based server, the content being streamed from the server 
once the necessary connection has been established. Thus, establishment of a 
streaming session requires the recipient to have knowledge of the location of the 
media content, but it does not necessarily require the media content to be directly 
1 0 addressed to the recipient. 

Now a new solution has been invented where the problems of the prior art can be 
avoided or at least mitigated. 

15 According to a first aspect of the invention there is provided a communication 
method comprising the steps of: 

receiving by a communication server content and information describing the 
content from a first temninal; and 

sending a notification message from the communication server to a second 
20 terminal, the notification message notifying about availability of the content; 
characterised by the method further comprising: 

fonming a streaming session between the communication server and the 
second terminal, using the infonnation describing the content; and 

transmitting the content in sequential sub-parts from the communication 
25 sery/er to the second terminal, during the streaming session. 

The transmission of the content to the second terminal as a stream allows rapid 
access to the content as a recipient using the second terminal need not wait for 
the content to be received completely. 

30 

Preferably, the content and the information describing the content are sent from 
the first temninal to the communication server in separate messages. This allows, 
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for example, separate sending of the content to one entity of the communication 
server and sending of a notification message to ttie recipients. 

Preferably, the Information describing the content is sent from the communication 
5 server to the second terminal within tiie notification message. 

Preferably, the method further comprises sending by the communication sen/er to 
the second terminal the Information describing ttie content as a media component 
of a multimedia message. 

10 

The sending of the description of the streamabie component as a media 
component allows utilising of existing multimedia messaging systems with minor 
changes. It airther allows embedding in tiie same multimedia message more than 
one media components, wherein some or all of tiie media components may be 
1 5 descriptions of streamabie components. 

Preferably, tiie multimedia message comprises at least one non-streamable 
component and at least one description of a streamabie component. 

20 Preferably, the communication method further comprises the step of presenting at 
the second tenninal the received content as a stream during tiie streaming 
session. The second tenninal can start presenting ttie content immediately and 
possibly take certain measures (for example, pausing or aborting tiie data 
transmission) during the transmission. 

25 

Preferably, the method further comprises the step of deciding at tiie second 
terminal to receive or not to receive the content, at a certain time, and ttie 
streaming session is only formed if the decision is to receive tiie content. 

30 Preferably, the communication server comprises a content server for storing and 
transmitting the content and a notification sender for receiving and transmitting 
notifications, wherein the content sender and the notification sender have a physical 
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relationship selected from the group consisting of the following: a single unit, 
separate units, and separate units distributed at different geographic locations. 

Preferably, the communication method further comprises the step of generating 
5 the content at the first terminal. Preferably, content generated at the first tenminal 
Is streamed to the content server and the sending of the content occurs during the 
generation of the content. By doing so the content can be made available to the 
user earlier than If content was generated wholly or to a large extent in the first 
terminal and only then streamed to the content server. 

10 

Preferably, when using streamed content generation, the infomnation describing 
the content Is sent before content generation is complete, so that the second 
terrrtineU can start receiving the content before ite generation Is complete. 

15 Preferably, during the streaming session between the communication sen/er and 
the second tenminal, the receiver can Issue an abort command to abort the 
session. Preferably, the streaming session Is aborted in response to the abort 
command. 

20 Preferably, the notification message comprises Information required by the second 
tenninal In order to forni a streaming session with the content server. 

Preferably, the method is Implemented as part of the Multimedia Messaging 
Service (MMS). 

25 

Preferably, the method further comprises the step of multicasting the content to at 
least one other terminal in addition to the second terminal In at least one other 
streaming session. 

30 In an embodiment in which there are a plurality of streaming sessions, each of the 
streaming sessions may be formed independently of any other, so that the 
sessions may start and end at different times or at the same time. Preferably, each 
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of the sessions can be aborted independently of any other, responsive to each of 
the respective terminals. 

According to a second aspect of the invention there Is provided a communications 
5 system comprising: 

a plurality of terminals including a first terminal and a second terminal; 
a communication server accessible to the plurality of terminals; 
means for sending the content and information describing the content from 
the first terminal to the communication server; and 
10 means for sending a notification message from the communication sen/er to 

the second tenninal; 

characterised by the system further comprising 

means for fonming a streaming session between the communication sender 
and the second terminal, using the information describing the content; and 
15 means for transmitting the content In sequential sub-parts from the 

communication server to the second tenninal, during the streaming session. 

Preferably, the system further comprises means for generating the content at a 
first terminal. 

20 

Preferably, the system further comprises means for presenting at the second 
terminal the received content as a stream, during the streaming session. 

According to a thinj aspect of the invention there is provided a communication 
25 sen/er for serving a plurality of terminals, the communication server cgmprising: 

means for receiving content and information describing the content from a 
first terminal; and 

means for sending a notification message to a second terminal, the 
notification message notifying the second terminal about availability of the content; 
30 characterised by the server further comprising: 

means for fomning a streaming session with the second temninal, using the 
infonnation describing the content; and 
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means for transmitting the content In sequential sub-parts to the second 
terminal, during the streaming session. 

According to a fourth aspect of the invention there is provided a computer program 
5 product comprising: 

computer program code for causing a communication server to receive 
content and infomiatlon describing the content from a first temilnal to a 
communication sen/er; and 

computer program code for causing the communication server to send a 
10 notification message from the communication sen/er to a second tenminal, the 
notification message notiiying the second terminal about availability of the content; 
characterised by the computer program product further comprising: 

computer program code for causing the communication server to form a 
streaming session between the communication sender and the second terminal, 
15 using the information describing the content; and 

computer program code for causing the communication server to transmit 
the content in sequential sub-parts from the communication server to the second 
terminal, during the streaming session. 

20 According to a fifth aspect of the invention there is provided a communication 
device comprising: 

means for receiving from a communication server information describing a 
message intended for the communication device; 
characterised by 
25 the message comprising a streamable component; 

the infomiation describing the message comprising Information describing 
the streamable component; and 

the communication device further comprising: 

means for fomning a streaming session with the communication server for 
30 receiving the streamable component, using the information describing the 
streamable component; and 

means for receiving the content in sequential sub-parts from the 
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communication server. 

According to a sixth aspect of the invention there is provided a computer program 
product comprising: 

computer program code for causing a communication device to receive 
from a communication sender information describing a message intended for the 
communication device; 
characterised by 

the message comprising a streamable component; 

the infomiation describing the message comprising infomiation describing 
the streamable component; and 

the computer program product further comprising: 

computer program code for causing the communication device to form, 
using the information describing the streamable component, a streaming session 
with the communication server for receiving the streamable component; and 

computer program code for causing the communication device to receive 
the content in sequential sub-parts from the communication sen/er. 

Preferably, the communication device is a wireless communication device. Even 
more preferably, the communication device is a mobile telephone. In an alternative 
embodiment, the wireless communication device is a wireless communication 
adapter adapted for providing wireless communication functionality to an external 
device such as a laptop PC. 

According to a seventh aspect there Is provided a method in a communication 
device, the method comprising the steps of: 

receiving from a communication server information describing a message 
intended for the communication device; 
characterised by 

the message comprising a streamable component; 

the information describing the message comprising information describing 
the streamable component; and 
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the method further comprising: 

forming a streaming session with the communication server for receiving 
the streamable component, by using the information describing the streamable 
component; and 

5 presenting the streamable component during the streaming session. 

The embodiments of one aspect also apply to various other aspects of the 
Invention. In sake of brevity, all the embodiments have not been repeated in 
connection with every aspect of the Invention. A skilled reader will appreciate the 
10 advantages of the various aspects and embodiments based on the advantages of 
the first aspect and its embodiments. 

The Invention will now be described, by way of example only, with reference to the 
accompanying drawings, in which: 
15 Rgur© 1 tea sehematto diagram of an Internet-based e-mail system; 

Figure 2 tea diagrarn of a communication system according to a prefen-ed 

embodiment of the Invention; 
Figure 3 shows the main protocol layers of streamed data transmfesion In the 

system of Figure 2; 

20 Figure 4 shows the structure of messages sent during streamed data 

transmtesion between a receiver and a media server according to the 
prefenred embodiment of the Invention; 
Rgure 5 shows a block diagram of a mobile communteations temiinal 

incorporating a cellular radiotelephone according to a prefen'ed 
25 embodiment of the invention; and 

Figure 6 shows a radio adapter card for a laptop PC according to an 
alternative embodiment of the invention. 



30 



Figure 1 has been described already in the foregoing. 

Next, a prefen'ed embodiment of the invention is briefly summarised and then fully 
disclosed with reference to Figures 2 to 6. 
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According to a preferred embodiment of tiie invention, streaming is incorporated 
within the [Vlultimedia Messaging Sen/Ice (MMS). A three-phase approach is taken 
in this regard. In a first phase (phase 1), a sender (sending terminai) transfers a 
multimedia message, or more accurately, media content, to a media (streaming) 

5 server. In a second phase (phase 2), one or more receivers (receiving temninals) is 
or are notified that media content is available for delivery. In a third phase (phase 
3), the media content Is transferred to the receiver or receivers. Advantageously, 
the notification performed In phase 2, takes place by means of a notiffeation 
message sent from the sender via a Multimedia Messaging Server (MMS) to the 

10 receiver. Typically, the MMS server stores the notification message and then tries 
to forward it to tiie receiver. If it fails in the fonwarding, It tries to re-send the stored 
not'rfication message at a later time. 

Advant£^eousty, streaming is performed in the first and third phases, namely while 
15 uploading the media content to the media (streaming) sender and while 
downloading the media content from the media (streamir^) server. It should be 
noted that streaming during the uploading phase (phase 1) is not an essential 
feature of the method according to the invention. However, the use of streaming in 
both phases 1 and 3 can reduce the delay between starting transmission of the 
20 media content from the sender and the commencement of streaming at the 
receiver. It may also have the effect of reducing storage requirements in the media 
(streaming) sender and can effectively enable implementation of real-time or near 
real-time streaming in the MMS. 

25 Phase 2 of the method can be regarded as a message control phase, which takes 
care of fonwarding a multimedia message and streaming-related information to a 
recipient (a target receiver of a multimedia message) via the MMS server. Phases 
1 and 2 may be perfomied sequentially or substantially simultaneously, white 
phase 3 can be performed automatically on receipt of the notification message at 

30 the receiver, or at some later time at the discretion of a user of the receiver. Thus, 
the invention provides the flexibility to play the streamed media content at the 
receiver at any time. The prefenred embodiment does not impose any limitation on 
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the size of the media content or the number of recipients in the case of 
multicasting. The preferred embodiment is based on a store-and-fonvard approach 
and it is thus in-line with other MMS solutions. This enables any media content 
that is not to be streamed or is not of a type suitable for streaming to be 
5 downloaded to the receiver in a conventional manner that is as specified in current 
MMS specifications. 

It is an advantage of the present invention that the implementation of streaming 
functionality can enhance the proposed MMS in many ways, particularly when the 

10 media content is large or it Is to be multicast. The store-and-fonA^ard approach to 
streaming in MMS is effective and desirable, since it provides the receiver with 
complete flexibility to decide whether and when to receive and play back the 
media content within a multimedia message. The Invention also provides 
streaming functionality within ttie framework of the proposed MMS and is thus fully 

1 5 compatible with the easting MMS standards. 

The embodiments of the Invention described hereafter outline the main steps for 
streaming under MMS. 

20 Rgure 2 is a diagram of a communication system 20 according to a prefen^ed 
embodiment of the invention. The system 20 comprises a sender 21 » an MMS 
Centre (MMSC) having a media server 22 and an MMS sender 23, and a receiver 
24. The MMSC can also be referred to as a communication sender. 

25 in this example of a multimedia message streaming method, the sender 21 is a 
mobile terminal equipped with a video-camera 25 and a mtorophone (not shown) 
which creates media content (an audio/video clip) to be sent to the receiver 24. 
The receiver 24 is a mobile temninal equipped with appropriate presentation 
software and equipment to enable presentation of the media content (the 

30 audio/video clip). Typically, the sender 21 and the receiver 24 are similar devices, 
one of them being the sender 21 and another of the being the receiver 24 just 
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because of their roles as sending and receiving parties (sender and recipient). Tiie 
three phases of the method are described in detail In the following. 

In the phase 1, the sender 21 establishes a streaming session with the media 
5 (streaming) sen/er 22 which starts storing the media content in a predetermined 
location. This phase can be considered as a media upload phase. 

In the phase 2, the sender 21 sends a notification via the MIVIS sender 23 to the 
receiver 24 about the media content being stored. The notification includes 

10 presentation description infonnation required to establish another streaming 
session between the receiver 24 and the media server 22. The presentation 
description information includes, but is not limited to, the following data:, the 
networl< address of ttie media sen/er, details of an access mechanism by use of 
which media content can be retrieved from the media server 22, the type of media 

15 to be streamed, the encoding method(s) used to encode the media content and an 
indication of the transport protocol(s) to be used for media downloading. 

In the phase 3, the receiver 24 establishes a streaming session with the media 
server 22, based on the information received in the notification message and the 

20 receiver 24 starts to download and play the media. This phase can be considered 
as a media download phase. The media content is downloaded as a sequence of 
content sub-parts, each representing one iime period of the streaming session. 
The content sub-parts may be separate data paclcets, or one sub-part may be 
comprised by more than one data paclcet, depending the type of coding of the 

25 media content and payload size of the data packets. 

The media sen/er 22 and the IVIMS sen/er 23 can be merged together or 
maintained as different entities in the network depending on the implementation 
chosen by the sen/ice provider, which controls them. The media sen/er 22 can be 
30 located, for example, in a mobile communications networl< or can reside in the 
internet, possibly under the control of a service provider other than that 
responsible for provision of services in the mobile communications network. 
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When streaming is used both In the phase 1 and In the phase 3, the (notification) 
phase 2 is perfomned during the (media upload) phase 1 and the (media 
download) phase 3 can also be started during the phase 1. The sender 21 
continues to send the media content to the media server 22 while the media sender 
5 22 simultaneously sends those parts of the media content received earlier to the 
receiver 24. The receiver 24 starts (and continues) playing back the media content 
with a total delay that depends on the streaming process, data transmission 
delays, and the time at which the phase 3 was initiated. If the phase 3 is not 
started automatically, but only after prompting and receiving permission from the 
10 user of the receiver 24, the total delay is typically longer than if the phase 3 were 
to be initiated immediately on notification being received at the receiver 24. 

In an alternative embodiment the media content is already stored in the media 
server 22 and the sender 21 knows the presentation description infonnation of the 

15 media content In this case the phase 1 can be omitted. As stated above, 
streaming of media content is ndt essential to phase 1. For example, a non- 
stireaming eqjproach to phase 1 can be used in connection with the provision of 
media content from a comnnerdal content provider, sudi as a prov^er of news 
content, located In a communications network, such as the Internet. The content 

20 provider updates the media content stored on the media server 22 using non- 
streaming transmission over an IP connection and notifies potential recipients of 
media content about new clips of interest, using notification messages according 
to phase 2 of the invention. The redpients of notification messages would be, for 
example, users having a subscription with the parttoular content provider. Based 

25 on the notification message, at Individually convenient times, each recipient can 
decide whether to fomn a streaming session with the media server 22 In order to 
retrieve new media content made available by the particular content provider. This 
also represents an example of a multicasting approach to streaming using the 
multimedia messaging system according to the invention. 

30 

According to an alternative embodiment of the Invention, the presentation 
description information can be stored in a server other than the MMS server 23 or 
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the media server 22, for example in an e-mail or Web-server. In this embodiment, 
the notification message sent to the receiver 24 identifies the particular server on 
which the presentation description Information is stored and an access mechanism 
(HTTP GET, WSP GET, IMAP4, P0P3, RTSP DESCRIBE) can be used to 

5 retrieve the presentation description information from that location. Then the 
receiver 24 retrieves the presentation description information from the server 
identified in the notification message using the specified access mechanism. The 
presentation description Information thus retrieved then guides the receiver 24 to 
invoke phase 3 of the method for retrieving and playing the stored media content. 

10 If the server used to store presentation description Information Is the MMS server 
23, the existing MMS solution can be used directly to retrieve the presentation 
description Information. In this situation, the MMS notification from the sender 21 
to the MMS sender 23 carries presentation description infomnation and the 
presentetion description Information Is stored in the MMS sender 23. The 

15 notification from the server storing the presentation description to the receiver 24 
then canies the location of ttie stored presentation description, the sender address 
and other required infomiatlon. Finally, the receiver 24 follows the MMS to retrieve 
the presentation description from the MMS sender 23. 

20 It should thus be noted that. In certain situations, the Information content of the 
notification message sent from the sender 21 to the MMS sen/er 23 may be 
different from that sent from the MMS sender 23 to the receiver 24. 

According to a prefenred embodiment of the invention, if the senders 21 and 
25 receivers 24 are under the authority of different mutually linked MMS senrers (that 
is they have different "serving" multimedia servers), the notification message is 
carried over the link between the MMS senders. The number of sen/ers ttiat may 
be linked together between sennng MMS servers Is not limited for any end-to-end 
notification. 

30 

There are existing protocols for both streaming control and media transport In the 
Internet domain. Phases 1 and 3 can thus be implemented based on these 
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existing protocols. In this way, the solution provided by the present invention also 
ensures intennrorking witii the Internet, which is also an Important objective of 
current MMS standard. Phase 2 confonns to existing MMS standards and thus 
provides backward compatibility with previously proposed mechanisms for non- 
5 streamed media content downk)ad. 

Some practical approaches to accomplish the different phases of the preferred 
embodiment of the present invention are outlined below as examples. 

10 The Real Time Streaming Protocol (RTSP) is a client-server streaming control 
protocol that enables controlled delivery of streamed multimedia data over an IP 
network. It is an application-level protocol and can work in conjunction with either 
the Transmission Control Protocol (TCP) or User Datagram Protocol (UDP). RTSP 
provides scope to use RTP (Real-time Transport Protocol)/UDP or any other lower 

15 level protocol for media transport. RTSP comprises a set of methods/instructions 
to control streamed audio and/or video. In this regard, the most useful 
methods/lnstrucUons are OPTIONS. DESCRIBE, ANNOUNCE, SETUP, PLAY, 
PAUSE, TEARDOWN, REDIRECT and RECORD. The media upload and 
download can be Implemented using SETUP, PLAY, RECORD, PAUSE and 

20 TEARDOWN. 

The Hypertext Transport Protocol (HTTP) can also be used to enable and control 
the uploading and downloading of media content according to the Invention, using 
TCP as a transport protocol. HTTP has methods/lnstmctlons PUT and GET, 
25 conresponding to RECORD and PLAY In RTSP, which can be used for media 
uploading (phase 1) and downloading (phase 3). 

UDP Is a connectionless lightweight transport protocol providing communication 
with comparatively low latency. RTP is purposely designed for reed-time 
30 communication and Is implemented In such a way that it provides time-stamps and 
sequence numbers for data packets on top of UDP. Multicasting is possible using 
RTP. RTP is further designed to work in conjunction with the auxiliary control 
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protocol RTCP (Real-time Control Protocol) to obtain feedback on the quality of 
data transmission and information about participants in an on-going session. 
Together, RTF and RTCP pro\nde functionality and control mechanisms necessary 
for carrying real-time content and hence to enable streaming of media content and 
5 can thus be used in conjunction with the present invention. 

TCP Is a connection-orientated transport protocol. It ensures guaranteed and 
sequential reception of data packets at the cost of Increased latency and larger 
overhead compared with UDP. Multicasting is not possible with TCP, but TCP can 
,10 be used in streaming applications, If initial buffering time is not critical and the 
media clips to be streamed are comparatively short. 

Message control functionality is required on top of streaming control and media 
transport layers in order to incorporate streaming in the MMS. Rgure 3 shows the 

15 main protocol layers of a streamed data transmission system according to Rgure 
2. A message control layer 31 provides overall control of messaging functionality. 
For example, in the sender 21 the message control layer 31 is responsible for the 
assembly of media content into multimedia messages and fomiation of notification 
messages containing infonnation describing the media content, which are 

20 subsequently sent to the intended receiver(s) 24. In the receiver 24, the message 
control layer 31 is responsible for interpreting received notification messages, 
extracting information relating to the location of media content to be streamed and 
information necessary to form streaming sessions to retrieve the media content. 
The message control layer 31 is also responsible for controlling the transmission 

25 and reception of any media content that is not to be streamed and/or is not of a 
type suitable for streaming, according to existing MMS. 

A streaming control layer 32 is controlled by the message control layer 31. It is 
responsible for forming a streaming session for each type of media content to be 
30 streamed, according to information provided by the message control layer 31, or 
according to predefined rules for each media type. It is also responsible for 
controlling/regulating the streaming of media content once a streaming session is 
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established. In the sender 21, the streaming control layer 32 Is responsible for 
streamed uploading of media content to a media server 22 and conversely, in the 
receiver 24, it Is responsible for controlling the streamed downloading of media 
content from the media server 22. Alternatively, streaming control functionality 

5 may be provided in the media sen/er 22 In a situation, for example, in which 
streaming is performed In phase 1 and 3 In such a way as to provide real-time or 
near real-time streaming of media content between senders 21 and receivers 24. 
A media transport layer 33 handles the actual transportation of data using an 
appropriate transport protocol. The choice of protocol may be predefined for 

10 different media types or may be indicated to the media transport layer 33 via the 
message control and streaming control layers 31,32 In accordance with 
infonnation provided in the notification message. In a preferred embodiment, the 
media streaming control adapts the streaming in accordance with the data 
transmission channel condition as notified by the media transport layer 33. 

15 

Figure 4 shows the structure of different control messages sent between the 
receiver 24 and an MMSC (or media sender 22) during a streamed media content 
download according to a prefen^d embodiment of the invention. It illustrates the 
flow of infomnation to enable a media clip to be played in the receiver 24 using an 
20 RTSP session while using RTP/RTCP as a transport protocol. This gives an 
example of an approach that can be used for downloading a media clip in phase 3 
of the present invention. The control messages sent to the receiver 24 are next 
explained: 

25 The receiver 24 requests for the media content it has been notified about in phase 
2. The receiver 24 sends to the MMSC an RTSP setup message (41) for setting 
up a streaming session, and receives a con^sponding acloiowledgement 
(41_ACK). The receiver 24 next sends an. RTSP play instruction message (42) to 
the MMSC, and receives a corresponding aclaiowledgement (42_ACK). In 

30 response to the play instmctlon, the MMSC starts sending RTP audio (43) and 
RTP video (44) content to the receiver 24, according to the multinvedia message 
being sent. The receiver 24 may control the MMSC's sending of the media content 
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by an RTCP message (45). Once the user of the receiver 24 desires to pause the 
streaming downloading of content, he or she requests for pausing the streaming 
and, responsively, the receiver 24 sends an RTSP pause message (46) to the 
MMSC, and receives a corresponding acknowledgement (46_ACK). Responsive 
5 to the RTSP pause message, the MMSC pauses the sending of the media content 
(RTP audio and RTP video). Next, an RTSP teardown message (47) is sent from 
the receiver 24 to the IVIIVISC to end the RTP session, allowing the streaming be 
continued on a later occasion. A corresponding acknowledgement message 
(47_ACK) Is returned by the MMSC to the receiver 24. 

10 

By replacing the PLAY instnjction with RECORD, a similar session suitable for 
media uploading in phase 1 of the invention can be implemented, wherein in place 
of the receiver 24 there is the sender 21 . 

15 End-to^d notification is required for message control functionality because, as 
explained previously, the receiver 24 requires certain infonnation concerning the 
media content to be streamed in order to tal(e part In a streaming session. 
According to current MMS specificattons, infomriation describing media content Is 
encapsulated together with the media content itself and thus cannot be sent 
20 independently to the receiver 24. In the absence of such information, the receiver 
24 is unable to download the media content by streaming. By providing separate 
end-to-end communication of media presentation infomiation, the method 
according to the invention supplies the receiver 24 with the information it requires 
in order to download media content by streaming. Furthermore, the existing non- 
25 streaming MMS protocol has scope to allow communication of media presentation 
infomnation using end-to-end messaging via an MMS server, rendering the method 
according to the invention compatible with current MMS standards. 

RTSP is believed to represent a best mode for enabling and controlling streaming 
30 in phases 1 and 3. A certain degree of compromise in performance is required if 
RTP/UDP or TCP is used as a media transport protocol. Specifically, 
implementations using TCP do not provide multicasting functionality, as TCP is a 
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connection orientated protocol. Nevertheless, TCP represents a viable altennatlve 
media transport protocol that can be used in connection with the present invention. 
Indeed, Its connection-orientated nature may provide advantages In certain 
situations, particularly if a more secure streaming connection is desired. According 
5 to the preferred embodiment of the invention, the existing MMS protocol is used to 
provide end-to-end notification of presentation description infomiation from the 
sender 21 to the receiver 24 via the MMSC in phase 2. 

Figure 5 shows a block diagram of a mobile temiinal 50 (capable to be either the 

10 sender 21 or the receiver 24) incorporating a cellular radiotelephone. The mobile 
terminal 50 comprises a display 51 , a transceiver 52 for transmitting and receiving 
radio signals, a digital signal processor (DSP) 53 for processing data and voice 
Into and from the radio signals, a user input device such as a keypad or keyboard 
54, and a central processing unit 55, the operation of which is controlled by 

15 software. The mobile tenninal 50 further comprises a memory 56 for storing data 
. and the software. The memory is used by the DSP 53 and the CPU 55. The 
software comprises an operating system and appltoations for controlling tiie 
operation of the mobile terminal 50 and for providing certain functionality, such as 
MMS. The mobile terminal 50 also comprises a removable smart card such as a 

20 SIM 57 for subscriber Identification. The portion of the memory 56 that is dedicated 
to storing applications Is so-called non-volatile memory that retains Ks contents 
even if the mobile temiinal's power supply becomes depleted. The applications 
can be stored in any manner known In the art, including factory installation, storing 
from a personal computer and downloading over the air, for example from a sewer 

25 In a communications networic Ail of these techniques are known, for example, 
from the Nokia® 9110 Communteator. 

Figure 6 shows a radio adapter card 61 for a laptop PC 62 according to an 
embodiment of the invention, capable of acting as the sender 21 and as the 
30 receiver 24. The radio adapter card Is fitted into a PCMCIA-slot of the laptop PC 
62 (PCMCIA, Personal Computer Memory Card International Association). 
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While the Invention has been described in relation to its implementation in a 
communications network in which at least part of the network comprises a radio 
communication link, it should be emphasised that its use Is not in any way limited 
to this kind of network. The invention may equally well be implemented in networks 
5 where the physical connections between the various elements of the network 
(sender 21, receiver 24 and network senders) are implemented partially or entirely 
by means of fixed line connections. 

The operation of the servers and terminals involved with different embodiments of 
10 the Invention, such as the MMSC. the sender 21 and the receiver 24, is preferably 
oohtrolled by computer program products causing these entitles to operate 
according to the invention. 

Particular implementations and embodiments of the invention have been 
1 5 described. It is clear to a person skilled in the art that the Invention Is not restricted 
to details of the embodiments presented above, but that it can be implemented in 
other embodiments using equivalent means without deviating from the 
characteristics of the Invention. The scope of the invention is only restricted by the 
attached patent claims. 
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Claims 

1. A communication metfiod comprising the steps of: 

receiving by a communication server content and information descrtoing ttie 
5 content from a first terminal; and 

sending a notification message from tlie communication server to a second 
terminal, tlie notification message notifying about availability of the content; 
characterised by the method further comprising: 

forming a streaming session between the communication server and the 
10 second terminal, using the Information describing the content; and 

transmitting the content in sequential sub-parts from the communication 
server to the second temninal. during the streaming session. 

2. A communication nnethod according to dalm 1, further comprising sending the 
15 content and the mfomiatlon describing the content from the first terminal to the 

communication server in separate messages. 

3. A communication method according to claim 1 or 2, further comprising sending 
by the communication sender to the second terminal the infonnation describing 

20 the content as a media component of a multimedia message. 

4. A communication method according to any of the preceding claims, wherein 
the content comprises at least one non>streamable component and at least one 
description of a streamable component. 

25 

5. A communication method according to any of the preceding claims, further 
comprising requesting the content by the second terminal before the 
transmitting the content from the communication server to the second terminal. 

30 6. A communication method according to any of the preceding claims, further 
comprising generating the content at the first tem^inal. 
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7. A method according to claim 6. further comprising the step of streaming the 
content generated at the first tenminal to the communication server. 

8. A method according to claim 6 or 7, further comprising the step of sending the 
5 information describing the content before the content generation is complete. 

9. A method according to any of the preceding claims further comprising the step 
of sending the infonmation describing the content from the communication 
server to the second terminal within the notification message. 

10 

10. A method according to any of the preceding claims, wherein the 
communication server comprises a content sen/er for storing and transmitting 
the content and a notification server for receiving and transmitting notification 
messages, wherein the content server and the notification server have a 

15 physical relationship selected from the group consisting of: a single unit, 
separate units, and separate units distributed at different geographic locations. 

11. A method according to any of the preceding claims furtiier comprising 
implementing the method as part of a Multimedia Messaging Sen/ice (MMS). 

20 

12. A method according to any of the preceding claims further comprising 
multicasting the content to at least one other terminal in addition to the second 
temiinal. 

25 1 3. A communications system (20) comprising: 

a plurality of terminals (21,24) including a first tenninal (21) and a second 
temninal (24); 

a communication server (MMSC) accessible to the plurality of terminals; 
means (52) for sending content and information describing the content from 
30 the first terminal (21 ) to the communication sender (MMSC); and 

means (23) for sending a notification message from the communication 
server to the second terminal (24), the notification message notifying the second 



wo 02/11398 



PCT/nOl/00686 



26 



terminal (24) about availability of the content; 
characterised by the system further comprising 

means (22;52) for forming a streaming session between the communication 
sen/er (MMSC) and the second terminal (50), using the information describing the 
5 content; 

means (22) for transmitting the content in sequential sub-parts from the 
communication sender to the second terminal (24), during the streaming session. 

14. A communications system according to claim 13, further comprising means 
1 0 (25) for generating the content at the first terminal (21). 

15. A communications system according to claim 13 or 14, wherein the 
communication sender (MMSC) comprises a notification sen/er (23) for 
receiving the information describing the content from the first terminal (21) and 

1 5 for sending the notification message to the second terminal (24). 

16. A communications system according to any of the claims 13 to 15, wherein the 
communication sen/er further comprises a content sen/er (22) for receiving the 
content from the first terminal (21) and for transmitting the content to the 

20 second tenminal (24). 

17. A communication server (MMSC) for sen/ing a plurality of temilnals (21 ,24), the 
communication sen/er comprising: 

means for receiving from a first temnlnal (21) content and Infonmatlon 
25 describing the content; and 

means for sending a notification message to a second temiinal (24), the 
notification message notifying the second terminal about availability of the content; 
characterised by the communication server (MMSC) further comprising: 

means (22) for forming a streaming session with the second temiinal. using 
30 the information describing the content; and 

means (22) for transmitting the content in sequential sub-parts to the 
second terminal during the streaming session. 
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18. A computer program product comprising: 

computer program code for causing a communication server to receive 
content and infomnatlon describing the content from a first terminal; and 

computer program code for causing the communication server to send a 
5 notification message from the communication server to a second terminal, the 
notification message notifying the second terminal about availability of the content; 
characterised by the computer program product further comprising; 

computer program code for causing the communication sen/er to fomi a 
streaming session between the communication server and the second temninal, 
1 0 using the information describing the content; and 

computer program code for causing the communication server to transmit 
the content in sequential sub-parts from the communication server to the second 
terminal, during the streaming session. 

15 19. A communication device (21 ,24) comprising: 

means (52) for receiving from a communication server (MMSC,23) 
Information describing a message Intended for the communication device (21,24); 
characterised by 

the message comprising a streamable component; and 
20 the information describing the message comprising Information describing 

the streamable component; 
the communication device (21,24) further comprising: 

means (52,55) for forming, using the information describing the streamable 
component, a streaming session with the communication server (MMSC) for 
25 receiving the streamable component; and 

means (52) for receiving the content in sequential sub-parts from the 
communication server. 

20. A computer program product comprising: 
30 computer program code for causing a communication device to receive 

from a communication server information describing a message intended for the 
communication device; 
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characterised by 

the message comprising a streamable component; and 

the infomiation describing the message comprising information describing 
the streamabie component; 
the computer program product further comprising: . 

computer program code for causing the communication device to form, 
using the infonmation describing the streamable component, a streaming session 
with the communication server for receiving the streamable component; and 

computer program code for causing the communication device to receive 
the content in sequential sub-parts from the communication server. 
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